Automatically guided tools

ABSTRACT

A position correcting system, method and tool for guiding a tool during its use based on its location relative to the material being worked on. Provided is a system and tool which uses its auto correcting technology to precisely rout or cut material. The invention provides a camera which is used to track the visual features of the surface of the material being cut to build a map and locate an image on that map used to reference the location of the tool for auto-correction of the cutting path.

REFERENCE TO PRIORITY APPLICATIONS

The present application claims the benefit of priority under 35 U.S.C.§120 as a continuation of U.S. patent application Ser. No. 14/678,752,filed Apr. 3, 2015, which claims the benefit of priority under 35 U.S.C.§120 as a continuation of U.S. patent application Ser. No. 13/477,029,filed May 21, 2012, which claims the benefit of priority under 35 U.S.C.§119 to U.S. Provisional Patent Application No. 61/488,118 filed on May19, 2011, entitled “Automatically Guided Tools” and U.S. ProvisionalPatent Application No. 61/639,062 filed on Apr. 26, 2012, entitled“Automatically Guided Tools”, each of which are hereby incorporated byreference herein in their entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally to tools and methods for workingon a surface such as woodworking or printing. More particularly, thepresent invention relates to ways to determine the exact location of atool in reference to the surface of a material and using the location toauto-correct the tool along a predetermined path such as a cutting path.

2. Description of the Related Art

Current methods and tools that exist to help guide a tool, such as ahand tool, accurately today are premised on minimizing the movement ofthe tool in one or more directions. Tools that are more difficult tomove accurately are guided through the use of mechanical guides such asrailings or fences which can be put in place to assist the user inguiding the tool. These fences or guides limit movement since the toolis restricted by the guide. However, existing guide approaches areunsatisfactory, because they take a significant amount of time to set upand because guides do not support complex paths.

If the tool can be accurately positioned freehand, measuring devices maybe used to draw visual guides onto the material being used which canthen be manually followed. However, such visual guides are stilldifficult for the user to follow accurately leading to extensive usererror in the cutting plan.

Computer numerical control (“CNC”) machines or tools alleviate many ofthese problems by guiding a tool using a computer which has knowledge ofthe tool's position relative to its set up within the CNC machine andthe plan to be followed. CNC machines control movement of the tool tofollow the intended path. However, CNC machines are typically expensive,large, and difficult to set up, and most are limited to working withmaterials that fit within the CNC machine's physical housing.

SUMMARY OF THE INVENTION

An object of the present invention is to provide a system and method forguiding a tool with the precision and flexibility of CNC tools butwithout the need for CNC's large and expensive hardware. The presentinvention introduces the idea of a rig or frame with stage which can bepositioned on the surface of a piece of material. The present inventioncan then automatically determine its position on that material andthrough movement of the stage can accurately move the stage to anycoordinate on the material. In some embodiments of the presentinvention, a digital camera attached to the rig or frame is used todetect the position of the rig and stage. The digital camera can be usedto build a map of a piece of material and track the location of the rigand stage on the map. The present invention may include a tool mountedon the stage that can performs work on the surface of the material suchas cutting, drilling, sanding, printing or other tasks.

The present invention also provides for controlling the location of thestage, and any attached tool, relative to the material and a design orplan to adjust the stage and tool based on the sensed position. Thus, auser can free hand a design and the present invention will automaticallyadjust the stage and associated tool to precisely match the design planand eliminate or minimize human error. The present invention isparticularly useful for controlling a router which can be used to cutwood or other materials.

The present invention may make use of computer vision (“CV”) technologywhich allows input from a digital camera to be processed and understoodby a computer. The CV technology provides benefits to the presentinvention in that it provides the ability to determine the location ofthe rig relative to the material in a fast and accurate manner whilebeing economical from a hardware standpoint. The present invention maymake use of one or more CV or sensor based techniques.

The present invention provides a tool for automatically adjusting thelocation of a working member of the tool comprising: a stage adapted toreceive the working member; at least one motor adapted to move thestage; at least one motor controller that controls the at least onemotor; a processor in combination with one or more software applicationsfor processing data and providing information to the at least one motorcontroller; at least one camera adapted for use with the processor forcapturing images of a surface, wherein the captured images are processedto build a map of the surface; wherein a subsequent captured image ofthe surface is processed to determine the location and orientation ofthe tool relative to the map; and wherein the processor providesinformation to control the at least one motor to move the stage andworking member to a desired location. The location of the working memberor the location of the tool are calculated based upon the location atleast one of the at least one cameras. The tool may be one of: a router;a drill; a nail gun; a jigsaw, a scroll saw; or a printer. The workingmember may be one of: a cutting bit; a saw blade, a drill bit, a hammer,or a printer head. The tool may also provide a display screen indicatingthe location of the working member relative to at least a portion of themap. A design can be loaded into a memory adapted for use with theprocessor and displayed on the display relative to the map and locationof the working member. The design can be processed to determine anintended path for the working member based on the design and the map.The motor controller can, based on information received from theprocessor, moves the working member to a point on the intended path.

The present invention also provide a tool for automatically adjustingthe location of a working member of the tool comprising: a stage adaptedto receive the working member; at least one motor adapted to move thestage; at least one motor controller that controls the at least onemotor; a processor in combination with one or more software applicationsfor processing data and providing information to the at least one motorcontroller; at least one sensor adapted for use with the processor forcapturing information about a working piece, wherein the capturedinformation is processed to build a map of the working piece; whereinfurther sensor information is processed to determine the location andorientation of the tool relative to the map; and wherein the processorprovides control information to control the at least one motor to movethe stage and working member to a desired location. The location of theworking member may be determined based upon the location at least one ofthe at least one sensors. The location of the tool may be determinedbased upon the location at least one of the at least one sensors. One ofthe sensors may be a camera.

Further, the present invention provides a rig for automaticallyadjusting the location of a working member comprising: a stage adaptedto receive the working member of a tool; at least one motor adapted tomove the stage; at least one motor controller that controls the at leastone motor; a processor in combination with one or more softwareapplications for processing data and providing information to the atleast one motor controller; at least one sensor adapted for use with theprocessor for capturing information about a working piece, wherein thecaptured information is processed to build a map of the working piece;wherein further sensor information is processed to determine thelocation and orientation of the working member relative to the map; andwherein the processor provides control information to control the atleast one motor to move the stage and working member to a desiredlocation. The location of the working member may be determined basedupon the location at least one of the at least one sensors. The locationof the tool may be determined based upon the location at least one ofthe at least one sensors. Further, the location of the rig may be basedon the location of at least one of the at least one sensors. One of thesensors may be a camera. The tool which mates with the stage may be oneof: a router; a drill; a nail gun; a jigsaw, a scroll saw; or a printer.The working member in the rig may be one of: a cutting bit; a saw blade,a drill bit, a hammer, or a printer head. The rig may further comprise adisplay screen indicating the location of the working member relative toat least a portion of the map. A design can be loaded into a memoryadapted for use with the processor and displayed on the display relativeto the map and location of the working member. The design can be loadedinto a memory adapted for use with the processor, wherein an intendedpath for the working member is determined based on the design and themap. The motor control information can move the working member to apoint on the intended path.

The rig of the present invention can also perform the method of:selecting and registering a design to be rendered; preparing andaligning a position of the tool on the rig; advancing the tool in afirst direction and within a selected range substantially adjacent to anoutline of the design; and automatically realigning the tool to aboundary edge of the design in a second direction as the tool isadvanced in the first direction.

Further, the present invention provides a method of locating a tool on amaterial, the tool being attached to a stage on a rig, comprising thesteps of: selecting and registering a design to be rendered; preparingand aligning a position of the tool; advancing the tool in a firstdirection and within a selected range substantially adjacent to anoutline of the design; and automatically realigning the tool to aboundary edge of the design in a second direction as the tool isadvanced in the first direction. Further steps include the aligning of aposition of the tool is performed by comparing the position of at leastone marker disposed on the material to the registered position of thedesign. Additionally, the selected range substantially adjacent to anoutline of the design can be a target range window displaying anillustration of: the tool, an intended cut path and a desired toolmovement path that may be different from the intended cut path.

Further, the present invention may automatically realign the tool to aboundary edge of the design in a second direction by a repositioningmechanism, as the tool is advanced in the first direction. The methodsof the present invention may automatically realign in response toreceiving image data from a camera or in response to the processing of areceived capture of an image of a marker on the material.

The present invention also provides a method of cutting a design in amaterial based on a relative constant speed of movement of a tool, thetool being attached to a stage on a rig, comprising: displaying a targetrange window rendering an illustration of a point of reference of thetool, an intended cut path and a desired tool movement path that may bedifferent from the intended cut path; aligning and advancing the tool ina first direction at the relative constant speed of movement along thedesired tool movement path to cut away the material at the intended cutpath; and automatically realigning the tool in a second direction to aboundary edge location of the intended cut path as the tool is advancedat the relative constant speed of movement in the first direction alongthe design. The target range window may include a target range area thatsurrounds the point of reference of the tool, a portion of the intendedcut path and a portion of the desired tool movement path. The desiredtool movement path is in at least one of a clockwise or counterclockwisecontinuous movement around a perimeter of the design. The design may bea virtual overlay in the target range window. The system mayautomatically realign a position of the tool based on a comparison of aprevious position on the design and a preferred next position on thedesign. Further, an automatic realigning of the tool to a boundary edgeof the design in a second direction may be performed automatically by arepositioning mechanism, as the tool is advanced in the first direction.Further, the automatic repositioning of the tool accounts for the widthof a cutting member of the tool relative to the intended cut path.Automatic realigning of the tool may be in response to receiving livefeed of image data from a camera.

These and other objects, features, and/or advantages may accrue fromvarious aspects of embodiments of the present invention, as described inmore detail below.

BRIEF DESCRIPTION OF THE DRAWINGS

Various exemplary embodiments of this invention will be described indetail, wherein like reference numerals refer to identical or similarcomponents or steps, with reference to the following figures, wherein:

FIG. 1 depicts a front view of an exemplary embodiment of the presentinvention with a router attached;

FIG. 2 provides a front view of an exemplary embodiment of the presentinvention without a tool attached;

FIG. 3 provides a side view of an exemplary embodiment of the presentinvention with a router attached;

FIG. 4 provides a side view of an exemplary embodiment of the presentinvention without a tool attached;

FIG. 5 provides a rear view of an exemplary embodiment of the presentinvention with a router attached;

FIG. 6 provides a rear view of an exemplary embodiment of the presentinvention without a tool attached;

FIG. 7 provides a to view of an exemplary embodiment of the presentinvention with a router attached;

FIG. 8 provides a perspective view of the bottom of an exemplaryembodiment of the present invention without a tool attached;

FIG. 9 provides a bottom view of the internal stage and pivot componentsan exemplary embodiment of the present invention;

FIG. 10 provides a flow chart of the steps performed by the presentinvention during operation;

FIG. 11 provides a flow chart of the steps performed by the presentinvention during the constant speed process;

FIG. 12 provides a system element diagram of the present invention;

FIG. 13 provides a perspective view of a second exemplary embodiment ofthe present invention;

FIG. 14 provides a perspective view of a third exemplary embodiment ofthe present invention; and

FIG. 15 provides a representation of the graphical user interfaceprovided on the display of the system.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Particular embodiments of the present invention will now be described ingreater detail with reference to the figures. Like reference numeralsapply to similar parts throughout the several views.

This invention overcomes the conventional problems described above byproviding a handheld system which can identify the location of a tool,or the rig which contains a tool, relative to the material being workedon and can adjust the tool to the desired location. Therefore, thesystem can provide a handheld device with a working instrument capableof being operated by hand which can make precision adjustments of theworking instrument location based on spatial location to provide anaccurate path which the working instrument travels.

A diagram of the main system components is best depicted and describedin conjunction with FIG. 12. As seen in FIG. 12, a system 680 isprovided with a smart device 681. The smart device 681 provides acentral processing unit (“CPU”) or processor 683, software code 685which performs one or more processes, memory 687, and a display 689.

The smart device 681 may be one a self-contained unit or may have one ormore components separated. For example, the display 689 may be tetheredto the smart device 681 or integrated into the housing of the smartdevice 681. Likewise, the smart device 681 may be integrated as part ofthe system 680 so that the system is a self contained portable unit. Thesystem 680 also includes a camera 682 which is used in combination withthe smart device 681 to build a map 684 of the material to be worked on.The map 684 may be built in various ways including using computer vision(“CV”) and sensors. One CV technique that could be employed is using orbuilding a photo mosaic. A photo mosaic process including takingmultiple photographs of different parts of the same object and stitchingthem together to make one overall image covering the entire object.

Another technique which may be employed is simultaneous localization andmapping (“SLAM”). SLAM makes use of a sensor that in combination with aprocessor 683 and related software 685 is able to build a map 684 of thematerial being worked on while simultaneously determining the locationof the tool 699 relative to the map 684.

Specifically, after the map is built the camera 682 continues to captureimages of the material being worked on which are fed to and processed bythe smart device 681 to constantly determine the location of the tool699 or rig. The captured images are analyzed against the map 684 todetermine the geo location of the camera 681 relative to the material.Once the location of the camera 682 is determined, the location of therig is then a known offset from the camera 682 position as the camera682 is rigidly attached to the rig. The location of the tool 699relative to the rig is then computed from the current orientations ofthe motor shafts. The orientations of the motor shafts are known by“homing” them once and then tracking all steps taken since the homingprocess. Alternatively, encoders could be used instead of homing as theencoders would be able to tell the orientations of the shafts directly.Through the offsets and calculations, the system can identify thelocation of the tool 699 or rig relative to the material being workedon. The captured images which are analyzed against the map 684 mayinclude characteristics of the material such as wood grains anddeformations or may include markers placed on the material. Differentaspects of the mapping and location technology will be described in moredetail below.

The user may then input or load a design 686 or template into the smartdevice 681, adjust the size of the design 686 relative to the map 684 ofthe material to provide the user with a desired working path on thematerial being worked on.

In operation, as the system or rig 680 is moved by the user along thematerial being worked the smart device 681 processes the captured imagesfrom the camera 682, determines the location of the rig 680, andprovides a desired path to the user on display 689. Once the user hasplaced the rig 680 close to the desired path the rig or system 680automatically adjusts the position of the tool 699 to achieve theprecise working path stemming from the loaded design 686. The term “rig”and “system” are used interchangeably in the description of the presentinvention. However, the rig primarily refers to the physical deviceitself including all attachments. The system refers to the physicaldevice, all attachments, and all related technology and software codeembedded or included in some of the physical elements.

The system 680 adjusts the precise location of the tool 699 by adjustingthe geo location of the stage 690 or a moveable platform that the tool699 is attached to. The stage 690 is connected to an eccentric coupledto a motor shaft. As the motor shaft moves in a circular path theeccentric moves the stage 690 in complex arcs and paths. A pivot 694 isconnected to the stage and is also connected to an eccentric coupled toa second or pivot motor shaft. The pivot 694 is able to pull or push thestage 690 to achieve controlled movement of the stage within a 360degree range. The ultimate effect is that the eccentrics can be rotatedto position the stage in almost any XY position in the range.

The system 680 may use a reference lookup table which provides motorcoordinates related to stage positions, or uses calculations to adjustthe motors and move the stage 690 and the cutting bit of the tool 699connected to the stage 690 to the desired location. Further, the tool699 through movement of the stage 690 and pivot 694 is capable ofmovement in 360 degrees of movement in a two dimensional plane.Essentially, the cutting instrument of the tool can be moved anywherewithin the 360 degree window of the target range 408 (see FIG. 15).

In the exemplary embodiment, the stage 690 and pivot 694 are moved byelectric motors. The stage motor 210 is controlled by a stage motorcontroller 691 and the pivot motor 220 is controlled by a pivot motorcontroller 695. The stage motor controller 691 and pivot motorcontroller 695 receive information on the desired location orcoordinates from the smart device 681. Based on the received informationthe stage motor controller 691 and pivot motor controller 695 activateand control their respective motors 210, 220 to place the stage 690 andthe pivot 694 in the proper position which places the tool in thedesired geo location.

The smart device 681 may also communicate with, receive informationfrom, and control the tool 699. Such control could include sendinginstructions to power on or off, increase or reduce speed, when toengage the material being worked such as adjusting the depth of the tool699 when the user is close enough to or near the desired path on thematerial.

The form and structure of an exemplary embodiment of the presentinvention for use with a cutting tool is provided and depicted in FIGS.1-9. The exemplary embodiment of the present invention depicted in FIGS.1-9 provides a system or rig 100 which is configured for use with arouter 500. The system 100 includes two support legs 104 which areattached to a base housing 130 on the lower end and terminate into adevice mount 122 at the upper end. The device mount 122 includes leftand right display clips 124 to clamp or lock the monitor or smart device570 into the device mount 122. The device 570 includes a display screen572 for the user to view the cutting path for that particular use. Thebase 130 also has left and right handles or grips 106 attached throughhandle support arms 108.

The lower end of the base 130 has a bottom plate 139 which encloses thestage 150 and a lower stage skid pad 151. The base 130 and bottom plate139 are fastened to one another such as by machined screws. As seen inFIG. 8, the bottom plate 139 has a bottom skid pad 141 attached to thebottom. The bottom skid pad 141 is used to assist movement of the rig100 along the surface of the material being worked on. The bottom skidpad 141 may be made of a high density polyethylene, Teflon, or othersuitable material which is both durable and suited for sliding along thematerial.

The router 500 is added to the rig 100 by attaching the router baseplate 510 to the stage 150. As seen in FIG. 9, the stage 150 has severaltool attachment points 164 for attaching the router base 510 to thestage 150. The router base 510 has several router base support legs 508which forms a cage around the router bit 512. The router 500 also has apower cord 506 and an on-off switch 504. As mentioned previously, therig 100 may be implemented as a self contained portable unit includingan on-board source of power, such as a battery source.

The smart unit or monitor 570 has an input cable 574 with a cableterminal or receptacle 576. If the device is a smart unit the CPU,software, and memory will be on the device itself. If the device 570 issimply a monitor then the cable 574 and receptacle 576 will connect tothe CPU unit.

As best seen in FIGS. 2-7, the system 100 contains a stage motor 210 anda pivot motor 220. The stage motor 210 is used to control movement ofthe stage 150. The pivot motor 220 is used to control movement of thepivot arm 156 which pulls or pushes the stage 150 to convert therotational motion of the motors 210, 220 into a relatively linearmotion. The stage motor 210 and pivot motor 220 each have their ownmotor cap 212, 222 respectively.

The motors 210, 220 are controlled by the stage motor driver 253 and thepivot motor driver 254 which are connected to the printed circuit board250 and the microcontroller board 252. The microcontroller 252 processeslow level instructions from the smart device or CPU unit (i.e. alaptop). The instructions would be instructions to move the motors 210,220 to set positions (i.e. positions 150, 125) into the correct stepcommands to drive the motors to those positions. The motors'orientations are tracked by homing them to a zero position once and thentracking all subsequent steps taken. Alternatively, the system could userotary encoders to keep track of the state of the motor shafts'orientations. The motors 210, 220 and the motor drivers 253, 254 arepowered by connecting the power plug receptacle 255 into a power source.

As seen in FIGS. 3-4, the back of the rig 100 includes a camera support190. The camera support 190 may be one or more support members which areconnected to the upper stage housing 130 and terminate at the top of therig 100 where a camera 300 is mounted. The camera 300 and a lens 304 areplaced in a relatively downward position to capture images of thematerial being worked and the surrounding areas thereof.

In this exemplary embodiment, eccentrics were used to convert therotational motion of the motors into linear motion. Eccentrics arecircular disks rotating around an off-center shaft. As the shafts arerotated, they produce linear motion in the collars wrapped around theeccentric disks. Eccentrics are able to maintain the same low backlashaccuracy of a precision linear stage while being less expensive. Alinear displacement range of ½″ is well within the capabilities of aneccentric. The present exemplary embodiment consists of two eccentricsmounted to the frame and connected to a stage that can slide on itsbase. The eccentrics are rotated by stepper motors, and by rotating themthe stage can be moved within the frame. The size and shape of thevarious eccentrics can be varied to provide larger or smaller relativemovement of the tool 699 relative to the workspace.

To properly constrain the stage, one eccentric is connected directly tothe stage by a ball bearing coupling, while the other is connected by acoupling and a hinge. This linkage design results in a nonlinearrelationship between eccentric orientation and stage position. Near thecenter of the range moderate rotation of an eccentric produces moderatemotion of the stage. In contrast, near the edge of the range much largerrotations are necessary to move the stage a fixed amount. In the presentinvention, stage displacement is limited to approximately 95% of themaximum range to avoid positions with extreme nonlinearity. This linkagedesign also permits back driving, in that forces acting on the tool cancause the cams to rotate away from their target positions. However, thepresent invention makes use of adequately powered motors which havesufficient power to preclude back driving even in the presence ofsignificant forces.

As seen in FIG. 9, the upper stage housing 130 is a one piece unit withspacers 131, 133, 135 machined or formed into the upper stage housing130. The spacers 131, 133, 135 provide the required space for the stage150 and pivot arm 156 to move. The front spacers 131, side spacers 133,and rear spacers 135 need not be formed as one unit. Instead, the frontspacers 131, side spacers 133, and rear spacers 135 could be separatepieces attached to the upper stage housing 130. The upper stage housing130 also accommodates several upper stage skid pads 137. The upper stageskid pads 137 allow the stage stabilizing arms 152 to move along thepads 137 with minimal friction.

The stage 150 is ideally made of a light but durable and strong materialsuch as aluminum or some other alloy. The stage 150 is most likelymachined to include one or more stabilizing arms 152, the stageeccentric arm member 154, tool attachment points 168, and an opening 160where the tool extends through the stage 150. In addition, a pivot arm156 is most likely machined from the same alloy or material as the stage150.

In operation the stage motor 210 moves in response to rotation of thestage motor shaft 184. There is a stage eccentric cam member 174attached to the stage motor shaft 184. When the stage motor shaft 184rotates the stage eccentric cam 174 rotates and the cam design causesthe stage arm member 154 connected to and surrounding the cam 174 tomove the stage 150. A bearing ring may be used between the cam 174 andthe stage arm member 154.

Additionally, when the pivot motor 220 moves the pivot motor shaft 186rotates. There is a pivot eccentric cam member 176 attached to the pivotmotor shaft 186. When the pivot motor shaft 186 rotates the pivoteccentric cam 176 rotates and the cam design causes the pivot arm member154 connected to and surrounding the cam 176 to move the pivot arm 156back and forth which causes the stage 150 to move relative to the pivotarm 156. A bearing ring may be used between the cam 176 and the pivotarm 156.

As the stage 150 and pivot arm 154 move, the stage stabilizing arms 152move along the upper stage skid pads and the lower stage skid pad 151(see FIG. 1) to stabilize the stage 150 during movement. Further, thestage eccentric 174 and pivot eccentric 176 include a boss. The bossgives the eccentric 174, 176 some extra material to house the set screwwhich clamps on the stage motor shaft 184 or pivot motor shaft 186, thussecurely attaching it to the respective eccentric 174, 176. The pivoteccentric boss 187 is seen in FIG. 9. The stage eccentric boss is notshown in the figures as it is flipped relative to the pivot boss 187because the stage 150 and the pivot arm 156 are operating on differentplanes.

By way of example, FIG. 15 depicts the monitor or display 572 as theuser pulls or pushes the rig 100 using the handles 106. The router bit512 (as shown by the crosshairs 410) of the router 500 cuts the material402 being worked on. The user sees the intended path 404 (as shown indashed lines) of the design on the display 572 of the monitor or smartdevice 570. The display 572 shows the desired path 406 as well as thetarget range 408. The target range 408 is related to the range ofmovement of the stage 150 and correspondingly the attached tool. Thus,if the range of movement of the router is generally 0.5 inches in anydirection from its center point then the target range 408 would best bedefined as a circle with a one inch diameter since the router bit canonly move 0.5 inches from the center point. Thus, the user would need tomove the router bit 410 within 0.5 inches of the intended path 404. Oncethe rig 100 is within 0.5 inches of the target range 408 the CPU wouldautomatically identify a target point on the intended path 404. The CPUwould send instructions to the motor controllers to move the stage 150to the appropriate coordinates which correspond with the bit 410reaching the target point and cutting along the intended path 406. It'simportant to note that the system can account for the width of thecutting bit 410. If the system were to place the router bit 410 directlyon the intended cut path 404 the width of the router blade would causethe router to remove material beyond the intended cut path 404. Thesystem accounts for the width of the cutting bit 410 by setting thedesired path 406 some distance from the intended path so that the bit410 only takes out material up to, but not beyond, the intended cut path404. Since cutting elements or bits have different widths the system canbe adjusted to remove or vary the bit width adjustment or the gapbetween the intended cut path 404 and the desired path 406.

As the system cuts or reaches one target point, the system wouldidentify a next target point and continue in this process cutting alongthe intended path in a clockwise direction. The user would continue topull or push the rig 100 via the handles 106 keeping the intended path(a line or area) within the target range 408 as seen on monitor 572. Amore detailed flow and process is described in conjunction with FIGS. 10and 11.

FIG. 10 provides a flow chart showing the steps or method 600 forcutting a working surface using the router based embodiment of thepresent invention. First in step 602 the user would find or create adesign they want to cut out of a material. The user would then need tomap the sheet of material. If the material has enough markings the usercould use the material itself. However, in step 604, if the material hasa flat surface or limited markings the user can place markers on thematerial. Such markers might include printer marker stickers and/or anyother type of suitable indicia capable of being readily identified.

In step 606, the user uses the camera technology to scan the materialand the various markers to create the map. The CPU processes the imagescaptured by the camera and generates the map. The size and shape of themap can be appropriately manipulated to a preferred configuration. Thedesign is then registered to the map to create a cutting plan (step608).

In step 610, the user prepares the cutting tool by loading, adjusting,or securing the bit, mounting it to the rig and turning the router on.In the alternative, and as mentioned previously, it is to be understoodthat the turning on of the router can be a software initiated process inresponse a variety of parameters, as opposed to a mechanical switch,such as motion sensing of a movement of the rig 100 in a particulardirection by the user, or the like.

In step 612, the user may set a few elements, such as width of the bitof the cutting tool, the range of the tool's desired range correction,the size of the cross-hair, the speed of the cutting tool, and the like.Thereafter, instructions may be provided to the software to begin.

In step 614, the rig is placed adjacent to the desired path so that thesystem can automatically adjust the position of the tool into a startingadjustment range position along the desired path. The user then followsthe “constant speed strategy” as will be described in more detail withregards to FIG. 11. Once the tool has advanced fully around the plan(step 616) the user can remove the device and work product from thematerial.

FIG. 11 provides a flow chart of method 650 for the constant speedstrategy. The process in FIG. 11 assumes the user already has the routerattached to the jig and has mapped their material and loaded up theirdesign. The user then starts (step 651) the process to cut the material.

In step 653, the user must move the tool to a spot within the range ofplan or path on the material. Once the user has moved the rig with therouter tool to a spot within range of the intended path, the system instep 655 determines based on its location if there is a point on theplan within the adjustment range of the rig. If not, the system in step657 may send a notification and waits until the user moves the devicewithin the adjustment range.

In step 659, if there is a point within the adjustment range the systemsets the point on the plan nearest to the tool as the target point. Thesystem in step 661 then moves the tool to the target point and cuts thematerial.

The system then attempts to create a second target by determining instep 663 if a new target is within the adjustment range. If there is asecond target, the system in step 665 sets the second target point asthe new target and the device continues to move in a clockwise directioncutting from the old target point to the new target point. As the toolor router is cutting from the old target point to the new target pointit is also attempting to identify the next target point within theadjustment range (step 663). The determination of an optimum secondtarget may be continuous, and based on the image, or various images,detected from the camera and processed by the system.

If not, the system (in step 667) clears the target point and starts backat step 655 to determine if there is a point on the plan within theadjustment range. This process continues until the tool has gone throughthe entire plan in a particular direction, such as a clockwisedirection.

As previously discussed above, FIG. 12 provides a system diagram of themain components of the present invention. The system 680 makes use of asmart device or system 681 which includes a CPU 683, software code 685which performs one or more processes, memory 687, and a display 689. Thesmart device 681 may be one contained unit which mounts onto the displaymount 122, 124 or may have one or more components separated butconnected. For example, the system may be connected to a laptop orremote CPU 683 which contains the software code 685 and memory 687 yetis tethered to a monitor 689. The monitor 689 may mount to the displaymount 122, 124.

The camera 682 is used to build a map 684 of the material to be workedon as well as determine the location of the rig 100 on the material. Asdiscussed, the system may use CV technology and other sensors to build aphoto mosaic map 684 of the material or could use the SLAM process. SLAMmakes use of a sensor that in combination with a processor 683 andrelated software 685 is able to build a map 684 of the material beingworked on while simultaneously determining the location of the tool 699relative to the map 684.

Through the present invention, as previously described, the system 680is able to locate a tool 699 or the working bit of a tool 699 on thesurface of a material being worked. The system 680 is able to locate thetool 699 on the material using a camera 682 positioned some distanceaway from the material based on looking and or mapping at the material.In one implementation, the camera 682 is first used to build a map 684of the material and is then used to locate itself (or the tool) on themap 684.

The map 684 can be built by having the user sweep the camera 300 in anarbitrary path over the surface of the material until the entire area ofinterest has been covered. The camera 682 can be removed from the rig100 for this step. The images from this sweep are then stitched togetherby the CPU 683 using the image mosaicing software code 685 to form acohesive map 684 of the area of interest of the surface of the material.Then, the user can return the camera 300 to the rig 100. Once the map684 is formed and saved in memory 687 whenever the camera 682 takes animage of the material it has mapped, it can be matched against the map684 held in memory 684 and its position and orientation determined.

This process may have an extra step in allowing the user to create andload a design 686. After the map 684 has been assembled on the smartdevice 681 (such as a computer), the user may create a design 686 on thecomputer by plotting it directly on the generated map 684. For example,the user may mark positions on a piece of wood where a drill hole isdesired. All the techniques and features of the software code 685(include computer aided design and manufacturing) can be employed tocreate a design with accurate measurements. Then, when the user returnsto the material, the position of the camera 682 on the map 684 can bedisplayed on a screen or display 689 to the user, with the design plan686 overlaid on the map 684. Essentially, the system 680 is able toidentify the geo location of the tool relative to the map. So, in theexample of drill holes, the camera 682 could be attached to a drill andused to determine the position of the drill exactly relative to thetarget drill locations specified in the design 686, enabling the user toline up the drill precisely.

A significant advantage of such a system is that it eliminatesmeasurement mistakes, as all measurements are performed on the computer681. Measurement is traditionally one of the most common sources oferror and such error would be negated by the present mapping andlocation aspects of the present invention.

Although described herein in combination with a router and separatelywith a drill bit, the camera 682 could be attached to any tool 699 toprovide positioning for that tool 699. The camera 682 could also becoupled with a display 689 and CPU 683 and become part of a computer orsmart device 681 that can be attached to any tool 699. Further, asoftware application or code 685 could be installed on a mobileSmartphone (such as an iPhone) utilizing the camera, CPU, memory, anddisplay already part of the Smartphone.

The system may perform the mapping and positioning steps simultaneously(i.e. “SLAM”, Simultaneous Localization and Mapping) and the system 680may use a video or still camera 682. The camera 682 may be directeddownward at the surface of the material, it could be positioned at anyangle, and it could sit at any vantage point on the tool 699 or rig 100(FIG. 1).

During the phase when the camera 682 is being used to locate itself onthe material, having low lag between moving the camera 682 and detectingthat movement can be important. One way to decrease lag is to use ahigh-frame rate camera 682. However, these can be expensive. Analternative is to use a relatively low-frame rate camera 682 coupledwith one or more optical sensors such as are present in optical mice.The optical sensors provide low-latency dead reckoning information.These sensors could be used in conjunction with the camera 682, forexample in a configuration where the camera 682 provides accurate globalposition information a few times a second and appreciable lag, and theoptical sensors are used to provide dead-reckoning information with lowlag that fills in the time since the last image was taken. The systemcould also make use of multiple cameras to increase the accuracy orrange of coverage when scanning, or to provide depth information.

There are also numerous options for creating, capturing, or loading thedesign 686. Designs could be downloaded or otherwise obtained fromothers including by purchasing designs online and uploading to the smartdevice or computer 681. Rather than creating the design 686 on aseparate computer and then uploading to the device 681 the system 680could be used to capture a map not only of the surface but of the design686 on that surface. This could be useful for setting up the system 680to follow a specific line or to show the user an image of the surface ofthe material underneath a large tool which obstructs sight, or to showthe surface with a drawn plan in a pristine state before it is coveredwith debris or the surface on which the plan is drawn is cut away.Alternatively, the design 686 could be designed, altered, or manipulatedfrom its original form on the device 681 through a menu driven interfaceallowing the user to input distances, angles, and shapes or to free handa drawing on a touch sensitive pad or display.

In an exemplary embodiment, the software 685 is able to build the mapand track the camera's position using visible features of the materialsuch as grains, imperfections, and marks. However, some materials, suchas solid-colored plastic, may be too undifferentiated for this to work.In these instances, the user may alter the material surface in some wayto add features that can be tracked. There are many possible ways thiscould be done: the user could apply ink to the material that istypically invisible, but which can be seen either in a non-visiblespectrum or in the visible spectrum when UV light is applied (orsimilar), allowing the camera to track the pattern of the invisible inkwhile not showing any visible markings once the work is done.Alternatively, the user could apply stickers with markers which canlater be removed. Features could also be projected onto the materialsuch as with a projector. Or, if the user will later paint over thematerial or for other reasons does not care about the appearance of thematerial, the user could simply mark up the material with a pencil ormarker.

In cases where the camera cannot track the material, or cannot do soaccurately enough, or the material is unsuitable for tracking (e.g. dueto an uneven surface), or any other reason that prevents the cameratracking the surface directly, the camera may instead track othermarkers off of the material. For example, the user could put wallsabove, below, or around the sides of the material being worked on thathave specific features or marks. The features or marks on thesurrounding surfaces enable the camera to determine its position on thematerial. Alternatively, different types of positioning technology ordevices could be used to locate the tool 699 or stage 690, possibly inconjunction with a camera 682 that is used mainly for recording thevisual appearance of the material without needing to perform thetracking function. Such could be the use of ultrasonic, IR rangefinding, lasers and the like.

As previously discussed in conjunction with FIGS. 1-9, the presentinvention described a handheld computer controlled router system usingan eccentric cam movement of a stage to control the router. However,eccentric cam movement is not the only design or method that can beemployed to move a tool or stage. As seen in FIG. 13, a linear baseddesign is depicted. The system 700 includes a router 701 which ismounted to a tool arm 702. The tool arm 702 is built on top of thelinear stage base 706. The linear stage base 706 moves in a back andforth direction along the axis line formed by the lead screw 705 and theprecision nut 707. Linear movement is achieved by controlling thestepper motor 710 which turns the lead screw 705 which moves theprecision nut 707 forcing the linear stage base 706 to move. The steppermotor and end of the linear system are mounted on the base 709. Handles708 are attached to the base 709 for users to move the system 700 on thematerial.

The linear system 700 would still use the camera 704 or sensortechnology previously described to map the surface of the material anddetermine the coordinates or location of the device 700 on the material.The user would scan the material with the camera 704 to make a map asdescribed above. Next the user would create, download, or otherwiseobtain a design and register it onto the map of the material. Finally,the user would return to the material with the tool, and follow the cutlines of the plan as closely as possible. Typically, the user would gripthe device 700 by the handles 708 and move the device forward whiletrying to keep the router 701 on the intended cut path or line. Whiledoing so, when the user would inadvertently drift off of the exact cutline or path, the system would detect the error. Since the system 700knows both its location and the plan it would power the stepper motor710 to rotate the lead screw 705 to move the router 701 by moving thelinear stage base 706 to such a point where the cutting bit intersectsthe plan line exactly. In this way, the present invention can be used tomake complex, curved, and/or precise cuts that could not otherwise bemade by hand.

Both the eccentric and linear embodiments could employ a monitor ordisplay to communicate or display the location of the tool relative tothe intended path. The system could also use other methods such asshining a laser point or line where the user should go or somecombination thereof.

In certain instances, the tool may need to cut design, such as on atable top or sign, where the cut does not go all the way through and ittakes more than one pass to remove all the material required for thedesign. In such instances, the CPU sends signals to the motors to movethe router back and forth within the target range until all material hasbeen removed in accordance with the design. The system can also beconfigured to provide a notice to the user to wait until all suchmaterial within the target range has been removed. The system can alsonotify the user when it has completed its design in a certain regionthus notifying the user it is time to move forward to a new target area.

In addition, the router could be configured to follow a line drawn ontothe material itself. In this embodiment, the camera would be placed atthe front of the operating tool and would see the drawn line. The systemwould still use location mapping to stay accurate to the drawn line.

An alternative embodiment using various aspects of the present inventionwould be for use of the material mapping and tool location for use inprinting. Again, the user would build a map and upload a design andwould be able to print the design section by section on a large canvas.The system would know which color or colors to emit based on the designand location of the printing tool. After the user mapped the materialand uploaded the design the user would simply pass the device over thematerial to print the image.

The printer embodiment could be manually guided or automaticallypositioned with wheels (or treads, or other) like a robot. As seen inFIG. 14, a printer embodiment 800 is provided. As with the tool basedembodiments, the system 800 includes a camera 801 which is used to builda map of the surface and track the position of the device 800 on thesurface. The printer head 805 can slide along a linear stage 806 poweredby a stepper motor 807 which rotates a lead screw 803 which moves aprecision nut 804.

In one instance, the user builds up a map of the surface and registersan image that is to be printed to that surface. The user then positionsthe device 800 at one side of the intended printed area. The camera 801takes an image and determines its position on the surface. The printerhead 805 is then moved from one end of the linear stage 806 to the otherto lay down a strip of ink. The device 800 is then moved forward thewidth of one strip of ink (or slightly less to prevent gaps) by steppermotors 802 attached to wheels 809. The printer embodiment 800 also haswheels 811 which are merely to roll when the motor driven wheels 809 aredriven. Once the printer 800 has determined its in the correct place forthe next strip, the printer prints the strip of ink and repeats untilthe edge of the image has been reached. In this way, the printer 800 canlay down a band of ink as wide as a strip's length and arbitrarily long.At this point, the printer can either move itself to the next positionto start laying down another band of ink, or the user can do thismanually.

Various embodiments of the printer system 800 can work either in realtime (i.e., printing as it is moving) or by taking steps (printing onlywhen at a stop). Different embodiments can be made to suit differenttasks: e.g., a high-speed, real-time version might be built to printbillboards, which have low accuracy requirements, while a more precise,slower, step-taking device might be built to do accurate large-formatprinting, e.g. of posters. Either approach can also be made to work on awall, which would make it possible to print murals, advertisements, orother images directly onto a wall, rather than having to print the imageon wall paper and then stick it up. In addition, this tool could easilybe made to work with curved surfaces, which are typically extremelydifficult to cover with images.

The printer embodiment 800 could be adapted for use with any type ofpaint including inkjet, liquid or spray paints, markers, laser printingtechnology, latex based paints, and oil based paints.

The mapping phase could be also be bypassed if it was clear the materialsize was greater than the design. The user would simply determine astarting point that corresponds with a region on the design (i.e. thetop right corner) and the system 800 would start painting the image.Such would be useful when painting many copies of a single image in manylocations.

The embodiments discussed herein so far have focused on rigs whichaccommodate a tool being attached to a stage and the stage is moved orcontrolled by one or more motors. The linear design depicted a routermoved by a motor where the router is connected to a linear stage. Insuch instances, the router is attached or mounted as a separate unit.However, the system could easily be designed as one unit where thestage, motors moving the stage, controllers, and all within the samehousing and within the same power system as the housing and power of thetool. By way of example, the router housing would be enlarged to fit thestage and motors and might include a display integrated into thehousing. Through such an embodiment, the form factor might be improvedto look like a one piece tool.

The embodiments presented here are not meant to be exhaustive. Otherembodiments using the concepts introduced in the present invention arepossible. In addition, the components in these embodiments may beimplemented in a variety of different ways. For example, a linear stage,or a hinge joint, or an electromagnetic slide, or another positioningmechanism may be used to adjust a tool or the stage the tool is on inreaction to its detected position and its intended position.

By way of example, the present invention could also be used with drills,nail guns, and other tools that operate at a fixed position. In suchembodiments, the tool and software could be modified such that the planconsists of one or more target points instead of a full design. Thedevice could be moved by the user such that a target position is withinthe adjustment range. The software could then move the tool to thecorrect target position. The user could then use the tool to drill ahole, drive in a nail, or whatever the desired function is.

Alternatively, these tools can also be used without automaticadjustment. The stage, pivot, motors, and eccentrics could be removed.The tool could be attached to the lower stage housing. The softwarecould be modified such that the plan consists of one or more targetpoints. The user could move the device such that the tool is directlyover the target position. The user could use the location feedbackprovided on the display to perform accurate positioning.

In an alternative embodiment, the present invention could also be usedto position a jigsaw. A jigsaw blade can be rotated and moved in thedirection of the blade, but not moved perpendicular to the blade or itwill snap. The present invention could be modified to include a rotatingstage which would be placed on top of the positioning stage. The jigsawwould be attached to this rotating stage. The software would be modifiedto make the jigsaw follow the plan and rotate to the correctorientation, and made to ensure that the jigsaw was never movedperpendicular to the blade. A saber saw could also take the place of thejigsaw to achieve the same effect. The cutting implement would besteered by rotating the rotating stage, and the cutting implement couldbe moved along the direction of cutting by moving the positioning stage.

Another possibility would be to only support rotation and not supporttranslation. This could be done by automating the orientation of theblade in a scrolling jigsaw (which is a jigsaw with a blade that can berotated independently of the body). In this embodiment, the softwarewould only steer the blade to aim it at the correct course; the userwould be responsible for controlling its position.

The present invention could also be used to position a scroll saw. Inthis embodiment, the camera would be on the scroll saw, and the userwould move the material. The upper and lower arms of the scroll sawcould be mechanized such that they could be independently moved bycomputer control. The user would then move the material such that theplan lay within the adjustment range of the scroll saw, and the softwarewould adjust the scroll saw to follow the plan. The upper and lower armscould be moved to the same position, or moved independently to make cutsthat are not perpendicular to the material.

The invention could also be used in an alternative embodiment where theposition correcting device is mounted to a mobile platform. In thisembodiment, the device could be placed on material and left to driveitself around. The invention could also be used in an alternativeembodiment in which two mobile platforms stretch a cutting blade or wirebetween them. In this embodiment, each platform could be controlledindependently, allowing the cutting line to be moved arbitrarily in 3D,for example to cut foam.

The invention could also be used as an attachment to vehicles or workingequipment such as a dozer in which the position-correcting mechanism ismounted on the vehicle. In this embodiment, the vehicle could be drivenover a sheet of material such as steel plate lying on the ground, and acutting tool such as a plasma cutter could be used to cut the material.The invention could also be used as a plotting device or paintingdevice, for example to lay out lines on a football field or mark aconstruction site.

Although SLAM was described as the exemplary mode for mapping anddetermining the location of the tool 699, it is to be understood thatvarious other location processing and determining technologies arepossible, such as, but not limited to, integrating wireless positionsensing technologies, such as RF, near field communication, Bluetooth,laser tracking and sensing, and other suitable methods for determiningthe position of the tool 699 on top of the work piece.

Although various steps are described above according to the exemplarymethod of this invention, it is to be understood that some of the stepsdescribed above may be omitted, and others may be added withoutdeparting from the scope of this invention.

It will be recognized by those skilled in the art that changes ormodifications may be made to the above described embodiment withoutdeparting from the broad inventive concepts of the invention. It isunderstood therefore that the invention is not limited to the particularembodiment which is described, but is intended to cover allmodifications and changes within the scope and spirit of the invention.

What is claimed is:
 1. A method for modifying a material with anautomatically guided tool, comprising: registering, by one or moreprocessors of a tool comprising a working member, a multidimensionaldesign to be rendered on the material by the working member, the designformed of one or more paths; determining, by the tool, a first positionof the working member relative to a path of the one or more paths, thetool advanced in a direction to place the working member at the firstposition within a target range of the path; and instructing, by the oneor more processors responsive to the tool advanced in the direction toplace the working member at the first position not on the path, acomponent of the tool to move the working member from the first positionnot on the path to a second position on the path.
 2. The method of claim1, comprising: receiving, by one or more sensors of the tool,information indicative of the first position of the working member ofthe tool.
 3. The method of claim 1, comprising: capturing, by one ormore sensors of the tool, image information of the material; anddetermining, by the tool, the first position using the image informationcaptured by the one or more sensors.
 4. The method of claim 1,comprising: capturing, by the one or more sensors during a timeinterval, a plurality of images of a surface of the material; anddetermining, by the tool, the first position using the plurality ofimages captured by the one or more sensors during the time interval. 5.The method of claim 4, wherein the time interval comprises 1 second. 6.The method of claim 1, wherein the time interval comprises 0.5 seconds.7. The method of claim 1, comprising: obtain, by the tool via one ormore sensors of the tool, a plurality of images of a surface of thematerial; and stitching, by the tool, the plurality of images togetherto build a map of the surface of the material.
 8. The method of claim 1comprising: moving, by the tool, the working member relative to a frameof the tool to place the working member at the second position at thepath.
 9. The method of claim 1, comprising: providing, by the tool,instructions to move the working member based on a time interval. 10.The method of claim 1, comprising: determining, by the tool, based onthe path, a plurality of positions relative to the frame; and providing,by the tool, one or more instructions to move the working member to theplurality of positions, the tool advanced in the direction that iswithin the range adjacent to the path for the working member of thetool.
 11. The method of claim 1, comprising: displaying, by the tool viaa display device of the tool, an image of the material; and displaying,by the tool via the display device, one or more indications of the firstposition of the working member overlaid on the image of the material.12. The method of claim 1, comprising: displaying, by the tool via adisplay device of the tool, an image of the material; and displaying, bythe tool via the display device, the path of the one or more paths ofthe design overlaid on the image of the material.
 13. The method ofclaim 1, comprising: displaying, by the tool via a display device of thetool, an image of the material; displaying, by the tool via the displaydevice, one or more indications of the first position of the workingmember overlaid on the image of the material; and displaying, by thetool via the display device, the path of the one or more paths of thedesign overlaid on the image of the material.
 14. The method of claim 1,comprising: moving, by a robot external to the tool, the tool to placethe working member at the first position.
 15. The method of claim 1,comprising: advancing the tool in the direction via a skid padcontacting the material.
 16. A system to modify a material with anautomatically guided tool, comprising: a tool comprising one or moreprocessors and a working member, the tool configured to: register amultidimensional design to be rendered on the material by the workingmember, the design formed of one or more paths; determine a firstposition of the working member relative to a path of the one or morepaths, the tool advanced in a direction to place the working member atthe first position within a target range of the path; and instruct,responsive to the tool advanced in the direction to place the workingmember at the first position not on the path, a component of the tool tomove the working member from the first position not on the path to asecond position on the path.
 17. The system of claim 16, comprises: oneor more sensors; and the tool configured to receive, from the one ormore sensors, information indicative of the first position of theworking member of the tool.
 18. The system of claim 16, wherein the toolcomprises one or more sensors, the tool configured to: capture, via theone or more sensors, image information of the material; and determinethe first position using the image information captured by the one ormore sensors.
 19. The system of claim 16, comprising the tool configuredto move the working member relative to a frame of the tool to place theworking member at the second position at the path.
 20. The system ofclaim 16, comprising the tool configured to: determine, based on thepath, a plurality of positions relative to the frame; and provide one ormore instructions to move the working member to the plurality ofpositions, the tool advanced in the direction that is within the rangeadjacent to the path for the working member of the tool.